Papers with LLaMA architecture
ECHO-LLaMA: Efficient Caching for High-Performance LLaMA Training (2025.emnlp-industry)
Copied to clipboard
Maryam Dialameh, Rezaul Karim, Hossein Rajabzadeh, Omar Mohamed Awad, Boxing Chen, Hyock Ju Kwon, Walid Ahmed, Yang Liu
| Challenge: | ECHO-LLaMA transforms LLa MA models into shared KV caching across certain layers, significantly reducing KV computational complexity while maintaining or improving language performance. |
| Approach: | They propose an efficient LLaMA architecture that transforms LLama models into shared KV caching across certain layers, reducing computational complexity while maintaining or improving language performance. |
| Outcome: | ECHO-LLaMA achieves up to 77% higher token-per-second throughput during training, up to 16% higher Model FLOPs Utilization (MFU) and up to 14% lower loss when trained on an equal number of tokens. |
HapticLLaMA: A Multimodal Sensory Language Model for Haptic Captioning (2026.findings-eacl)
Copied to clipboard
| Challenge: | haptic captioning is the task of generating natural language descriptions from haptics, such as vibrations, for use in virtual reality and rehabilitation applications. |
| Approach: | They propose a multimodal sensory language model that interprets vibration signals into descriptions in a given sensory, emotional, or associative category. |
| Outcome: | The proposed model interprets vibration signals into descriptions in a given sensory, emotional, or associative category. |